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A relationship is derived between the delay characteristic in a data trans- 
mission system and the distortion in the form of intersymbol interference 
created by the delay variation. The relationship is valid for small delay and 
involves a sequence of linear functionals, each of which has a particular sig- 
nificance. In addition to applications in the analysis of specific systems, 
problems of a more general nature may be studied using this approach. By 
various manipulations on the sequence of functionals, bounds on distortion 
in terms of rms and peak-to-peak delay are derived. On examining the prob- 
lem of delay equalization, a set of virtually distortion-free delay functions is 
derived and related to minimum-effort and compromise equalization. Both 
low-pass and bandpass sijstems are discussed in turn, with the same general 
method, of analysis applying to each. 

I. INTRODUCTION 

In this paper we will analyze and discuss one aspect of the problems 
associated with the transmission of digital data through an unknown 
linear network. The particular aspect with which we will be concerned is 
the effect of delay distortion on the fidelity of the transmission. Delay 
distortion arises generally from nonlinearity in the phase shift with fre- 
quency of the system transmission characteristic. This nonlinearity 
causes different frequencies of the input waveform to arrive at the re- 
ceiver at different times, thereby distorting the input waveform. 

The problem of delay distortion is particularly acute in the voice tele- 
phone network. Since speech is relatively insensitive to phase, the 
switched telephone network has not been equalized for phase shift as 
well as it has been for attenuation. However, the need has now arisen 
to make use of this network for transmission of digital data at high 
speeds. The digital data receiver takes the waveforms it receives quite 
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literally and becomes hopelessly confused by delay distortion if we try 
to send at too high a rate. For instance, in a voice-band channel of 3 kc 
Nyquist's famous result tells us that it might be possible to send 6000 
independent signals (representing data symbols) per second. However, 
the usual rate is around 1000 symbols per second (2000 bits for quater- 
nary systems), and higher speeds are impossible because of transmission 
distortion. 

In subsequent sections of this paper we will be concerned with quanti- 
tative effects that delay distortion has on data transmission. This does 
not mean that we will analyze any particular system operating in the 
presence of a particularly shaped delay variation. This has been done 
previously by a number of authors, but notably E. Sunde. 1 2 ,3 A Rather, 
we will be more concerned with the gross features of the relationship 
between delay and system performance. For example, if a particular level 
of performance is required, what standards may be set on delay such that 
this minimum performance level will be guaranteed? What shapes of de- 
lay are particularly bad or good? How well does differential delay (the 
difference between the maximum and minimum values of delay across 
the band) define performance? If a channel is equalized within a certain 
tolerance of delay, what level of performance can be achieved? 

Inasmuch as the telephone network consists of an ensemble of trans- 
mission characteristics from which the channel is randomly chosen, these 
questions would seem to be more meaningful than specific performance 
figures for particular channels. Consider the problem of comparing data 
systems for transmission over the voice network. It is clear that this sus- 
ceptibility to delay distortion is an important factor in such a comparison. 
The performance of system A will be a random variable defined over the 
set of possible connections we could dial, likewise system B. The ana- 
lytical portion of comparing the two systems would be best shown as 
the probability distributions of performance for the two systems. One 
system could only be said to be statistically "better" than the other. 
For example, its average performance over the ensemble of channels 
might be greater. 

Data are now becoming available on the delay characteristics of the 
voice network (e.g., Alexander, Gryb and Nast). 5 Using these data, it 
might be possible to analyze systems for which the delay characteristic 
is chosen randomly from this network, or it might be possible to synthe- 
size systems which operate well (with high probability) over this net- 
work. The latter could be accomplished by taking advantage of certain 
features common to the majority of delay characteristics. One way of 
doing this is to use a "compromise" equalizer. Quite a question exists as 
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to how to design such an equalizer and how much would be gained by 
its use. Other possibilities include the use of a bank or set of equalizers 
from which a best choice may be made for each call or the ultimate use 
of automatic equalization. 

In the remainder of this paper we will show an approximate method 
whereby the effects of delay distortion may be easily considered in an- 
swering such questions as we have asked here. The first section will be 
devoted to explaining what performance criterion will be used whereby 
a particular channel may be judged as to goodness for data transmission. 
In subsequent sections the criterion suggested will be manipulated to 
show clearly its dependence on delay for both lowpass and bandpass sys- 
tems. A summary of results obtained is presented following the section 
on criteria. 

II. A PERFORMANCE CRITERION 

What we seek in this section is a criterion which may be applied to a 
transmission channel to determine how good the channel is for data trans- 
mission. Obviously, such a criterion should depend upon what system we 
intend to use over the channel as well as upon the noise environment and 
input data statistics and the over-all system performance criterion (such 
as probability of error) that is used. A channel can't be said to be "good" 
or "bad" irrespective of how we intend to use it. Therefore, the only 
exact thing which can be done is to treat each possible system sepa- 
rately and derive the relationship between delay and performance sepa- 
rately for each. 

For example, Sunde 1 ■- ,3 A has analyzed several common systems such 
as AM, PM, and FM in a noiseless environment, using the deviation of 
the detector output voltage from its undistorted values as a measure of 
performance. When the details are carried out, the system performance 
is given as a function of sample values of the impulse response of the 
over-all system. We call this impulse response h{t) 

h(t) = - [ A(u>) cos [at - 0(a)] du (1) 

where A(u) includes signal shaping at the receiver and transmitter as 
well as the attenuation characteristic of the channel and /3(w) is the 
channel phase characteristic. Unfortunately, the relationship between 
the samples of h(t) and system performance is a complicated one and it 
is unclear as to how the shape of the delay, /3'(w), affects the perform- 
ance. 
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What we shall do is to take one specific system, amplitude modulation, 
and show that its performance is monotonically related to a quantity 
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which we shall call distortion. 

Now, in later sections of this paper we will see how the shape of delay 
affects this distortion measure. Therefore, the results given in these sec- 
tions may be interpreted as performance for AM systems. However, we 
shall argue that this distortion measure may be quite plausible even 
though the system being used is not AM. Indeed, many common sys- 
tems may have their performance related monotonically to D. This is 
to say that a channel which is bad for AM is probably bad for PM too. 
This may be considered similar to the "What's good for General Bull- 
moose is good for the U.S.A." proposition, but the thought may also occur 
that, considering the unknown nature of the noise and input data sta- 
tistics, the criterion (2) may be just as good a starting point as some 
arbitrary definition of environment and performance measure. At any 
rate, we do not intend to dwell on the difficult problem of criteria here. 
The criterion D is monotonically related to performance for linear sys- 
tems and for those systems which can be approximated as linear. 

2.1 The Performance of a Simple Baseband System 

A mathematical model of this system is shown in Fig. 1. The trans- 
mitted signal consists of amplitude-modulated waveforms whose shape 
isft(f) 
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Fig. 1 — A baseband amplitude-modulated system. 
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and is generated in our mathematical model (not in practice) by a train 
of area-modulated delta functions pulsing a filter whose impulse response 
is gi(t). The transfer function of the channel is G t (w)e mu) ', so that the 
over-all transfer function for the impulse is A(u)e' w , with 

A(«) = Gi(w)Gt(u). 

In the noiseless case, the received signal y(t) is 

y(l) = r° h( r ) £ a,Ml - nT - r) dr (4) 

where h(t) is the over-all system impulse response 

h(t) = - [ A(u) cos [«/ - £(«)] do. (5) 

Equation (4) may be written 

f(t) = ^aMt-nT). (6) 

We sample this received signal at regular intervals of T seconds starting 
at time /„ . At time /„ we expect the amplitude a„ , but we actually get 

y(h) = £ a,Mt - nT) = £ a_Ji(*o + nT) (7) 

H =—oo n=— oo 

which is a function of the history of the data sequence \a„\. For some 
sequences y(t ) will be more likely to be detected wrongly than for 
others. The error due to intersymbol interference is 

E = do - y(to) = ao[l - M'o)l " L «-»M*o + wT). (8) 



n=-=o 



Now, we are interested in the maximum value this error (which is fre- 
quently termed the eye opening) can assume. Assuming the maximum 
positive and negative values of the coefficients a„ are a and — d re- 
spectively, this maximum error is easily written as 

B„ = *[1 - h(to)} - d £' | h(t Q + nT) |. (9) 

The first term represents an amplification or attenuation of the signal 
by the channel, while the second term represents the worst possible 
effect of intersymbol interference. The prime in the summation sign 
means deletion of the n = term 
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?' =„£,- (10) 

With the attenuation h(t ) dose to unity* or normalized, we nee that 
the distortion is proportional to 

D = 2'lMfc + nT) |. (11) 

If the noise were additive with a unimodal distribution, the maximum 
probability of error over all sequences would be a monotonic function 
of D. For example, if the levels o„ are spaced equally between -\-d and 
— d and there are N levels, the distance between levels is 

| o„ - o»_i | = "_ 1 (12) 

and the probability of making an error with Gaussian noise of mean 
zero and variance a' is 



max prob of error = prob ( | noise | > 
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The distortion D is a function of the initial delay, / . This sampling 
time is optimally chosen such that the criterion D is minimized. This 
best time is a functional of the delay /3'(co) through its influence on the 
impulse response. Unfortunately, it is extremely difficult to optimize 
to even for a specific impulse response. Therefore, we shall arbitrarily 
choose ( at the peak of the impulse response. This is a very good approxi- 
mation to the best possible sampling instant. 

2.2 Discussion of the Criterion D 

The distortion criterion D has been written as the sum of the absolute 
values of the system impulse response sampled at the symbol repetition 



* This is a second-order effect for the small-delay case in which we will be in- 
terested. 
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rate. The zero sample of impulse response, /i = h(t ), is taken at the 
peak of the response and is deleted from the summation. We have shown 
that for an amplitude-modulated system this criterion is proportional 
to the maximum deviation in the absence of noise of the detector output 
voltage. The maximum is taken over all possible input symbol sequences. 
This performance measure is frequently termed the "eye opening," from 
the resemblance to an eye when the output voltage is displayed on an 
oscilloscope while random patterns of input symbols are transmitted. 

That the criterion D is reasonable for most linear systems may be 
roughly shown. We recognize that h(t) represents the system memory, 
or response from past signals. At time / we are looking for symbol s , 
but unfortunately the system remembers remnants of past and future* 
symbols at this time. The symbols are spaced T seconds apart so that 
the nth past symbol is "remembered" with relative amplitude 

\h(t + nT) |. 

It makes sense that, the larger the sum of these relative memories, the 
worse will be the intersymbol interference. We will show in the course 
of our later work how well the performance of a nonlinear system employ- 
ing phase comparison detection is predicted by use of the distortion 
criterion D. 

2.3 A General Distortion Criterion^ 

More generally, we would wish to send the signals chosen from a set 
Si(t), i = 1, 2, • • • , N. Each symbol is chosen according to some prob- 
abilistic rule from this set in time sequence to form the signal 

*(0 = Zsn(f-nT). (16) 

The signals s,(i) are sometimes viewed as vectors in a Hilbert space or 
in some finite-dimensional subspace. The effect of sending the sequence 
x(t) through a linear network is to cause the received signal during a 
7'-second interval to be a linear combination of the desired signal vector 
and all other unwanted signal vectors rotated and attenuated by the 
channel. For a given channel, if we consider the position of the resultant 
vector for all possible infinite sequences of symbols, we define regions of 
uncertainty in signal space surrounding the unperturbed vectors s,- . 
For purposes of combating noise we are concerned with the distances 

* The memory of future symbols is possible because of the time delay t a between 
input and output. 

t This section is not essential to the understanding of subsequent material. 
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in signal space between the transmitted vectors, that is, with the num- 
bers || Si — Sj \\,i y£ j. The greater this set of numbers is, the greater the 
potential noise immunity of the system. The effect of the channel is to 
make these distances a function of the symbol sequence. So we can say 
something about what the channel has done to the noise immunity by 
specifying the minimum protective distance || s, — Sj ||, i ^ j, with and 
without the channel. Thus, we might define a measure of distortion as 



Do = 1 — mm 



[■ II Vi — Si 
m n — - 
Vi - Hi II s » s i 



(17) 



Ri = region of uncertainty due to intersymbol interference surrounding 
the symbol s,- . 

This criterion is illustrated in Fig. 2. The way the criterion was formu- 
lated did not take into effect the receiver characteristics, but rather 
evaluated the "loss of detectability" to an ideal maximum likelihood 
receiver owing to intersymbol interference. Notice also that this criterion 
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Fig. 2 — A genera] distortion criterion. 
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is dependent upon the system to the extent that it is a function of the 
set of possible signals, •<(<)• As was previously stated, it is impossible to 
eliminate system dependence from a criterion and maintain usefulness 
for all conditions. 

When this measure is applied to the AM system of Fig. 1, the result 
is the criterion D previously expressed in (2). 

III. SUMMARY OF RESULTS 

The problem now is to explore the functional dependence of the dis- 
tortion, D, upon the delay characteristic, /3'(w). As we have previously 
shown, the distortion D is a measure related to the eye opening for most 
linear systems. Specifically, for an JV-level AM system we have 

/*-,evelAM - 1 - (JV - 1)2>. (18) 

However, by ignoring second-order effects the criterion may be applied 
to some nonlinear systems. In examples used subsequently in the text, 
results are obtained for a four-phase data system using phase comparison 
detection. These results are in close agreement with published data on 
this system. The eye opening for this system is approximately 

A-pbuBe^l " D. (19) 

Similar expressions may be obtained for other systems. 

3.1 The Fundamental Equation 

In Section 4.1 an approximation of small delay is made. The validity 
of this approximation is explored in a later section, where it is shown to 
hold for all delay such that the peak delay is limited to 1 .1 pulse intervals. 
For most delay curves the range is wider than this figure, however, and 
accuracy is generally maintained when D ^ 0.0. 

The fundamental equation obtained with the aid of this approxima- 
tion relates the distortion to the delay variation through a sequence of 
linear functional 

D= 2 Z | 03', /J | (20) 

7T n=l 

where 

(0',fn) = fV(«)/«(«)A0. (2D 

Each linear functional yields the intersymbol interference from a par- 
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ticular range of symbols. For example, the adjacent symbol interference 



is 



|A,| + |JU| =-\(P',fi)\. (22) 

■K 

For real delay curves only the first few terms of (20) are usually signi- 
ficant. 

The linear functionals (/3',/„) are defined by a sequence of functions 
{/„} , independent of delay, obtained from the amplitude shaping of the 
system, A(u), by the following operation 

/„(&>) = / [a n x — sin nxT] A(x) dx (23) 



/: 



03 A (w) sin noiT rfco 

"■ '—r~, — ; - (24) 



3.2 Application 



Examples are given of the use of (20) in the analysis of system per- 
formance when raised cosine amplitude shaping is employed. By re- 
formulating the equation to 

D = - max (V, £ e„/„) (25) 

«■ [«n] \ "=1 / 

e n = ±1 

bounds on distortion in terms of delay may be derived. We find 

D ^ 1.15 X (rms delay) (26) 

D ^ 0.412 X (peak-to-peak delay) (27) 

with delay normalized so that the bandwidth w = ir. The delay curves 
which achieve equality in the bounds (26) and (27) are illustrated. Other 
bounds are considered. 

In computer simulations, experimental testing, and analysis it is fre- 
quently necessary to consider only finite-length input sequences resulting 
in an effective truncation of the system memory. The possible error in 
such results is examined and bounded. 

The effect of changing the input symbol rate upon distortion is ana- 
lyzed for a particular example where a binary system is compared with a 
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quaternary system operating at half speed (thus having the same infor- 
mation rate). Depending upon the particular delay function, either 
system may perform better than the other. However, it is shown that 
the quaternary system is ultimately the more sensitive to delay variation. 
Problems connected with delay equalization are approached with the 
aid of (20). In the equalization of a specific delay to achieve zero dis- 
tortion, it is necessary and sufficient that the resultant delay variation 
be orthogonal to all /„ . For raised cosine shaping there are an infinite 
number of nonconstant delay curves which have this property. An 
orthonormal basis for this space of distortionless delay is derived, and 
examples of projections yielding minimum effort equalization are given. 
[All curves so derived have, of course, zero distortion only to the order 
of approximation involved in (20)]. Optimum compromise equalization 
to match an ensemble of delay variations is also considered. 

3.3 Bandpass Modifications 

For bandpass systems the criterion D is reformulated using the sum 
of samples of the envelope of the impulse response 

D = £'P(*o + nT) (28) 

h{t) = P(t) cos M - <M01 (29) 

u c = carrier or reference frequency. 

A fundamental equation for bandpass systems analogous to (20) is 
derived involving quadrature components 

D = VD* + D q \ (30) 

The distortion component D r results from even components (for sym- 
metrical amplitude shaping) of delay variation, and the component D q 
results from odd components of delay variation. Each may be treated 
as in the low-pass analysis by a sequence of linear functionals 



2 

IT TT: 



Dr = -Z I (*',/») | (3D 



D q = -E |(/,/f)| (32) 



IT n=l 



where <p'(o)) is the bandpass delay and the sequences {/ r „} of even func- 
tions and {/,„! of odd functions are derived from the amplitude shaping 
by operations similar to (23). 

All results obtained for low-pass systems may also be obtained for 
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bandpass systems. For example, it is shown that for raised cosine ampli- 
tude shaping 

D ^ 1.337 X (rms delay) 

(33) 
D ^ 0.467 X (peak-to-peak delay). 

Thus the bandpass system is slightly more sensitive to delay distortion 
than its baseband equivalent. 

IV. THE RELATIONSHIP OF DISTORTION TO DELAY FOR LOW-PASS SYS- 
TEMS 

4.1 Derivation of a Sequence of Linear Functionate Relating Distortion, 
D, to Delay, /3'(a>) 

D = £' | h(io + nT) | - £' Mo + nT) (34) 

7i n 

f + 1 M/o + nT) ^ 

(35) 

[-1 h(l 4- nT) < 

D = E' e « ( Ma) cos [«(/o + nT) - /3(a))] da (36) 

Z> = l E' W. - e n S n ) (37) 

C„ = J A(<a) cos no>T cos [w/ - /3(a>)] do> (38) 

£, = / A{u) sin nwT sin [w/ - 0(w)] dco. (39) 

Jo 

Equations (34) to (39) are self-explanatory reformulations of the 
criterion D. Equation (37) is summed over all n, — °o to +°°, except 
n = 0. Because of the obvious symmetry properties of C n and <S„ , 
namely C n = C-„ and S n = —S-„ , we can rewrite (37) as a sum 
over positive integers only 

= - E [C„(e„ + 6_„) - S n (e n - •_)]. (40) 

Since e„ = ±1, one of the pair (e„ + e_„) and (e„ — e_„) is zero and the 
other must be ±2. Therefore the criterion becomes 

D = ?E max (| C.|, | S,| ). (41) 

IT n = l 
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What we are doing here is evaluating terms of the sum D of (34) two at 
a time. The integral C„ represents [h(t + nT) + h(t - nT)], while the 
integral 8 n represents [h(t u + nT) - h(ta - nT)]. Since what we want 
is | h(t + nT) | + | h(t — nT) |, this is equivalent to | C„ | if these two 
terms are of the same sign and is | S n | if they are of opposite sign. We 
shall now argue that, for small delay, \ S n \ > | C„ | and (41) may be 
summed over the S„ terms alone. 

Specifically, what we mean by small delay is that the sine and cosine 
of Mo — /3(w)] may be approximated by the first terms of their ex- 
pansions. Later we will investigate the conditions under which this 
approximation is valid. Making these approximations in (38) and (39) 
gives 

C„ = [ A(u) cos nwT dw = (42) 

(since we must assume that A(o)) is such that transmission is perfect in 
the absence of delay, distortion; i.e., h(nT) = 0, w ^ 0). 

S n = f Wh - /3(co)] .4(oj) smnwT du. (43) 

Thus we see that, to this order of approximation, terms linear in 
Mo - 0(»)L I S n | > | C n |,* and 

D = - E | S n | . (44) 



IT n=l 



Now, as we have previously explained, the initial delay / is ideally 
chosen so as to minimize D for a given h(t). Unfortunately this is im- 
possible to do analytically. We recognize that for zero delay distortion 
to = and that the presence of delay increases t . As a good approxima- 
tion to the ideal sampling time, we are using / as the time of the peak 
value of the impulse response h(t). An additional, and extremely im- 
portant, consideration in this choice is that the approximation of 
[ut — /3(a))] small has been made. To choose t at the peak of the im- 
pulse response results in the smallest possible values for the function 
[co/ — /3(w)]. We shall see this more clearly later on. 

* The second term in the cosine expansion is 

C w l 

— I - Mo — /3(w)] 2 .-l(w) cos nuT dw. 
J 2 

Since [ul — /3(«)] 2 < \ut D — /3(o>) | we would generally expect | C„ | to be smaller 
than | S n | . However, this is not necessarily true; e.g., [wt — /3(w)] may be or- 
thogonal to sin 7103T on the [0,w] interval. 
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We now solve for the time t as a functional of /3(co) using the equation 
h'(t ) = 

— 1 f w 
h'(t ) = = — / uA(u) sin [o>/ -/3(a>)] dw (45) 

IT Jo 

/ [«/ a - /9(w)]«i4(w) du> « (46) 

*'o 

/ wA(co)/3(co) dw 

'» - n^ • (47) 

/ CO A((ji) (Id) 

J(l 

Notice that / is a linear functional of /3(a>) and observe that conse- 
quently S„ , (43), is linear in /3(w). Therefore, according to the theorem 
of Riesz, S„ is expressible in the succinct form 

S« = / /»(«)/3'(«) dw (48) 

since /3(co) is linear in /3'(u). We now proceed to put «S„ into the form of 
(48). 
Combining (48) and (43), we write S n as 

S n = f /3(w)[a„w - smnwT]A(u) dw (49) 

where a„ does not depend on /?, i.e. 

/ uA(w) sin nuT do: 

/ u 2 A(w) dw 
J a 

Integrate (49) by parts to yield 

In- (• w 

S n = fi(u)g n (u) - I p'(a)gn(u) da> (50) 

|o J o 

g n (o)) = I [a n x — sin nxT] A (x) dx (51) 

J 

which may finally be manipulated to give 

S n = f /»(«)//(») rfco (52) 
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where 

f n ( a ) = J \a n x - sin nxT]A(x) dx. (53) 

We have now written the distortion D as 

D = - Z | S„ | (54) 

where each term S„ is a linear functional of delay and represents the 
distortion arising from intersymbol interference from symbols ±n sym- 
bols away. Obviously the terms S„ become quite insignificant for large n. 
For many delay curves, the principal interference is from adjacent sym- 
bols and only »S\ is of major importance. We shall demonstrate this when 
A(w) is the commonly used raised cosine shaping and the delay is 
parabolic. 

Using the Schwarz inequality in (52) gives a useful bound on *S'„ . 

IS. I ^ 11/- II WW (55) 



•M = 4/ fn(<») dw 



(56) 



/3 '" = v / ^( w ^ 2 dco = rmsdcla y x 



Thus we can see how fast the successive terms in (54) must approach 
zero. The total distortion is of course bounded by 

D ^-|/3'||i;||/»||. (57) 

IT ,,=1 

The norm || /„ || may be thought of as the sensitivity of a system to 
intersymbol interference at a distance of ±n symbols. The greater || /„ ||, 
the more sensitive the system is to delay distortion. 

The effect of the shape of the delay curve is clearly illustrated in (52), 
which is abbreviated 

S n = ( 07„) (58) 

and represents the inner (or scalar, or dot) product of the functions 
(vectors) /„ and fi'. S„ is less than or equal to the product of the lengths 
of the two vectors, which is what the Schwarz inequality in (55) says, 
and the equality occurs when the delay /3'(co) has the same shape as 
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While expression (57) represents an upper bound on the distortion as 
a function of rms delay, this bound is generally not realizable. In fact, 
this bound is generally useless, since the sum of the norms || /„ || fre- 
quently diverges. This does not mean the distortion can diverge, since 
this would require the delay to simultaneously have appreciable com- 
ponents in the direction of each of the vectors /„ . In the two examples 
we will study, it is shown that this divergence is possible in one case, 
where all the /„ are approximately in the same direction, whereas it is 
impossible in the other, where the /„ are nearly orthogonal. 

To find a least upper bound on distortion as a function of rms delay 
we write 

9 oo (+1 S n ^ 

D = - E €nS n *n = \ (59) 

17,1=1 -!S n <0 



9 °° 9 / °° \ 

D=-£e n (/3',/ n ) = -(/3',E *./»)• 



(60) 



The distortion D is thus a scalar product of delay and some combination 
of the functions/,, . The sequence of sign coefficients {e,,} is chosen so as 
to maximize this scalar product. The resulting value of D is the same as 
forming the sum of absolute values of the individual scalar products 

Using the Schwarz inequality in (60) we obtain 
D ^ _vw ^ ( rms delay) X max 







(61) 


\ii> 

n=l m=l 


nCml/nj/m) 


2 . (62) 



D ^ —^- — X (rms delay) X max 

Expression (62) is the least upper bound on distortion for a given value 
of rms delay, and the equality is obtained when 

/SiorBt = Z *nfn ■ (63) 

n=l 

The inequality (62) may be used to define the over-all sensitivity of a 
system to delay distortion 

D ^ (rms delay) X (sensitivity) (64) 



2vw> 
sensitivity = max 



' 00 00 ~~l\ 

n=l m=l J 



(65) 



The sensitivity is equal to 2\/w/ir times the length of the longest vector 
which can be obtained by summing the vectors ±/„ . 
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Wc also have the obvious bounds 



^[tllZ-ll 8 ]^ sensitivity 

* ^ [£ El (/»,/«) it 



(66) 



4.2 Example — Perfect Low-Pass System Operating at the Nyquist Rate 

As our first example we choose the "ideal" system, a perfect low-pass 
channel operating at a rate of 2W symbols per second 



(67) 



A(u) = 1 ^ CO ^ T 

A(w) = T ^ CO 

7' = 1 
u; = 7r. 
We now evaluate the function /„(«), using these values 

/„(«)=/' [a„.f - sin n.rT] d.T (68) 

/ co sin nco rfco „ 

„-*__- =»(-!)• (09) 

/ to (/to 

/„(«) = / [a„.T — sin nx] dx 

- (70) 
- (- 1 )" T A 2 _ (-D" cosnco _ ll 
n \_2ir 1 U n 2_| " 

If the delay is constant, say /?'(«) = c, we have 

S„ = (fi'jn) = c /"/-(«) d<* (71) 

Jo 

,S„ = i f^V " ) (-1)" - * ^* = 0. (72) 
n\3/\27r/ n 2 

Thus there is no distortion when the delay is constant. Of course we al- 
ready knew this, but it serves as a useful check on the method. 

Looking now at the system sensitivity, we compute the following 
products 
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nm 15 7r \m 3 w / J 

(73) 

1 TtT , 7T 6 1 

n 2 |_5 2n J irrrj 

Choose all the coefficients e„ as positive and it is immediately seen that 

2 r » » -ij 

sensitivity ^ T - ZE (/»,/») -> <=° (74) 

V7T _n=l m=l J 

Therefore the perfect low-pass channel is infinitely sensitive to delay 
distortion, so that the smallest increment of delay can result in diver- 
gence of the eye picture. This result is not entirely unexpected, and is a 
good reason for not using "perfect" channels even if they were physically 
realizable. 

4.3 The Raised Cosine System 

4.3.1 Derivation and Discussion of the Functions /„(co) 

Now, instead of the flat amplitude shaping of the previous example 
which was so sensitive to delay distortion, we use a more gradual cutoff. 
The raised cosine shaping is the shaping most frequently used in prac- 
tice, since it retains the proper zero crossings at the Nyquist rate and, as 
we will show, is less sensitive to delay distortion. Of course the penalty 
one pays for this protection against delay distortion is a doubling of the 
bandwidth for a given symbol rate as compared to the flat shaping 
previously discussed. 

For the raised cosine shaping we have 

A(u) = COS CO + 1 ^ CO ^ 7T 

A(«) =0 co ^ t (75) 

T = 2 w = ir 



On = 



/ co sin 2nco(cos co + 1) da 

Jo 



•'o 



cos co -f- 1) du) 



g- 2 ) 2 



2n(4n 2 - 1) 



(7(5) 



(77) 



Notice that o„ falls off as \/n as contrasted with the previous example 
where a n ~ 1/n. 
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/n(w) =* / [a„x — sin 2n.r](cos x + 1) d 

J (.1 



dx 
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(78) 



/„(co) = a„ cos w + ^t- — —-r cos (2n - 1 )« 
2(2n + 1) 

+ j- cos 2n&» + X cos (2n + l)o> (79) 

2n 2(2n + 1) 



a»w 



+ « n w sin a> H — — a„ 



l + l 



The first few functions /i(w), /a(w), and /a(w) are shown in Fig. 3. 
Observe that/i(«), representing adjacent symbol interference, has the 
greatest energy of these functions. Its shape in crude terms might be 
described as one cycle of cosine exponentially attenuated. The next 
function, fz(a>), consists of about 2 cycles of cosine with less exponential 
attenuation, and this trend continues for the higher-order functions. 
The effect of delay distortion on the raised cosine system can be visu- 
alized with the aid of these functions. About the worst form of delay 
consists of one cycle of delay looking like/i(u>). When the residual delay 
consists of a large number of ripples, say n cycles, then its distortion is 
not so great and comes largely from intersymbol interference at a dis- 
tance of n symbols. When the delay is a slowly varying function of oj, 



0.4 



oo 
DISTORTION = | XT |(f n ,/3')| 



/3' = DELAY 




TT/Z 



Fig. 3 — The functions /„(«) for raised cosine shaping. 
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the higher-order terms S„ = (f„ , /3') n > 1 become insignificant, and 
only adjacent symbol interference is of importance. 

4.3.2 Use of the Functions f„(u) in Computing Distortion 

All the functions /„(a>) integrate to zero over the [0,ir] interval, so 
there is no distortion when the delay is constant. Now suppose we have 
parabolic delay 

0'(a>) = ha. (80) 

This is the general shape of delay to bo expected in an unequalized 
voice channel. 

Carrying out the relevant integrations gives 

Si = ( A-o) 2 /i(co) rfco = -0.411*fc 

S 2 = 0.025ttA- (81) 

0.282wfc 

S n » — =— . 

In Ref. 2, Sunde computes the impulse response of a raised cosine 
network with parabolic delay distortion. In terms of the parameter m, 
the maximum delay in pulse intervals used in this reference, we find 

k = 2m/*- 1 . (82) 

Using a value of m = 2 we read from Sunde's curve* 

| Ai| -H | A_i J = 0.31 (83) 

while from (81 ) we have 

I hi | + | A-i I = - | Si I = 0.33. (84) 

IT 

The agreement is good, although the value of delay m = 2 is somewhat 
outside the range where the approximations are entirely valid. 

To compute the distortion arising from parabolic delay we form the 
sum 

D - - Z I S* | = 0.912L (85) 

7T n =l 



* We occasionally abbreviate h(t + nT) as simply h n ■ 
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Notice that some 90 per cent of this distortion is due to the term Si 
(adjacent symbol interference). For this general shape of delay the term 
Si = (/3',/i) would seem to be sufficiently indicative of system perform- 
ance. 

As another example of the computation of the effect of delay, we con- 
sider delay of the form 

/3' = a cos vu. (86) 

This cosinusoidal delay is of the type frequently encountered as residual 
delay after partial equalization or in wider band systems. Depending on 
the number of cycles of delay across the band v, only one or two of the 
terms S„ are of importance. These are the terms n W v. These various 
products (p'jn) are shown as a function of v in Fig. 4. Each product 
(0',/n) peaks for v a little less than n cycles and is very small elsewhere. 
Rappeport 7 has studied the effect of this type of delay on the 4-phase 
data set using phase comparison detection. This study was effected using 
a digital computer simulation of the system. Rappeport plots curves of 
eye opening versus the number of cycles of delay in the passband, v. 
Since the cosine is symmetrical, our low-pass results carry over directly 
to the passband in this case. The 4-phase system is essentially nonlinear 
because of the multiplication in the detection process. An exact expres- 
sion relating eye opening to impulse response is not derivable for this 
system. An approximate expression for the eye opening is 

I =\ - D. (87) 

This expression neglects terms involving products such as hji m . When 
the first four curves in Fig. 4 are summed to form D, the curve relating 
eye opening to delay frequency may be drawn as shown in Fig. 5. This 
curve is compared with the curve computed by Rappeport using a = 0.5 
in each case, and it is seen that the general agreement is quite good 
except for somewhat more oscillation in the latter than in the former. 

The exact eye opening for the 4-phase system depends not only on D, 
but on the relative magnitudes and signs of the samples h n which sum to 
form D. 

4.3.3 Sensitivity and Bounds on Distortion for Raised Cosine Shaping 

The sensitivity of the raised cosine system to delay distortion may be 
calculated from consideration of the functions /„ . For n > 4 the terms 
involving a„ become approximately negligible and /„ consists of the 
terms 
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3 4 5 6 7 8 9 

DELAY FREQUENCY, V, IN CYCLES 

Fig. 4 — Various components of distortion for cosine delay. 



/« 



rr-p-pr — - COS (2/1 — l)w + — COS 2/iOJ 

2(2n — 1) 2n 



+ 



1 



(88) 



cos (2n + l)co. 



2(2n - 1) 

Thus /„ becomes approximately orthogonal to all /„, except for m = n 
and m — n d= 1. There is an overlap between /,, and /, 1+ i in the term 
1/2 (2ri + 1) cos (2n 4- 1)oj and similarly an overlap between /„ and 
/„_i in the term l/2(2n — 1) cos (2n — l)a». Obviously, to construct 
the sequence ) «„/„} of greatest energy we choose the signs e„ such that 
all these shared cosine terms (the other terms are orthogonal) add in 
phase and thus reinforce each other. Thus it seems reasonable that 
c n = 4-1 for n ^ M. 
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DELAY FREQUENCY, V, IN CYCLES 

Fig. 5 — Eye opening for 4-phase data set for cosinusoidal delay. 

By an exhaustive search on a digital computer of the effect of the first 
twelve coefficients e„ , it was found that the maximum energy combina- 
tion occurred for all e„ = + 1 except for ei = e 2 = e 3 = — 1 . We designate 
this combination / me; .(a>) (maximum energy combination). This function 
has the worst shape a delay can assume for a given rms value, and 
the sensitivity of the system is proportional to the norm of this function 



/,„„,(«) = E/»(«) - 2[A(o>) +/ 2 ( w ) +/,(«)]. 

n— 1 

We first perforin the infinite summation involved here 

E /»(«) = cos w + w sin w +— — fl+— JE a » 



[89) 



£i I2(2n - 1 



cos (2to — l)i 



(90) 



4- =- cos 2rca> -f jry- — — — cos (2n + 1)» . 
2n 2(2/1 +1) J 

Both sums can be put in closed form. The first sum is 

E a„ = - 3 ,,. E ..} ., = 0.14973 (91) 

T^i 2(tt 2 — b) £=i n(4n 2 - 1) 

while the last sum in (90) may be recognized as simply 
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1 
Yl - cos nco 
7Zi n 


1 

— — COS 03 
— 




(92) 


which converges to 






-log 


• 03 

2sin- 


1 

— - COS CO. 
a 




(93) 


So that we finally find 






/mccCw) = 0.14973 Lo sin oj 

- log 2 sin | 


+ j - 2.64493 J - 

- 2/ 1 (o>) - 2/ 2 (co) 


0.35027 cos co 

- 2/sCco). 


(94) 



This function is shown in Fig. 6. A delay curve of this shape has maxi- 
mum detrimental effect on the raised cosine shaped system. The norm 
of /mec(w) was computed numerically to be 

11/n.eoH = 1-02 (95) 

and so the sensitivity of the raised cosine system is 

sensitivity = || / mec || = 1.15 (96) 

7T 

D g 1.15 X (rms delay) (97) 

In the previous paragraphs we investigated the effect of cosinusoidal 
delay. For this shape and for an amplitude a = 0.5, the bound (97) 
gives D £ 1.15 X 0.5 X 0.707 = 0.407, so the eye opening (1 - D) 
must be greater than or equal to 0.593. This value is shown on Fig. 5 
along with the curves representing actual and computed performance 
for the cosine delay. At the lowest dips in these curves the distortion is 
about § of the bound (97). The distortion computed for the parabolic 
delay distortion, however, is only about \ of its corresponding bound. 
As might be anticipated, the parabolic shape is a relatively weak form of 
delay distortion. 

It is also of interest to compute bounds on samples of the impulse 
response. 

I k | + 1 k-n i - - 1 (/3',/j i ^ 4= II /* I 1 x (rms dela y) (98) 

I h | + | h-i I = 0.829 X (rms delay) (99) 

\h I + U-2 1 ^ 0.443 X (rms delay) ( 100) 
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Fig. G — RMS bound on distortion; D = 1.15 X (rms delay). 

I h | + | h- 3 1 g 0.289 X (rms delay). (10i; 

For large n we have asymptotically 

V3 



K | + | h-n | ^ -^ X (rms delay). 



(102) 



Thus the individual samples of the impulse response are only bounded 
inversely proportionally to their distance from the peak time of the 
impulse response. In each case the maximum value is obtained when the 
delay is some constant times /„(<*>). However, the sum of all these terms 
can never exceed 1.15 X (rms delay), which paradoxically is less than 
the sum of the attainable bounds on only the first two terms. 
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Since adding or subtracting any constant delay does not affect the 
distortion D, the bounds given here are most effectively used by first 
subtracting the mean value of delay and dealing only with the varia- 
tional component. 

We can find similar bounds in terms of peak-to-peak constraints on 
the delay. The "differential" delay is frequently taken as the difference 
between the maximum and minimum values of delay across the band. 
We shall now find the shape of delay which maximizes distortion for a 
given peak-to-peak constraint and the corresponding value of distortion. 

From (60) we have 

D =- max (V, £ e,,/,,) . (103) 

If fi'(o)) is peak-limited then the maximum value of (103) is obtained 

when 0'(«) is chosen as +/3m» x when 23 c »/« is positive and — /3 mnx 

n=i 

00 

when 2 c «/n is negative. The resulting distortion is 



D = 2 I? 



„W I CO 

nax / z2 Cn/»(w) 

Unl J n=l 



(104) 
The problem reduces to finding the combination of signs {e„} such that 

00 

the absolute integral of ^ e„/„(w) is maximized. We call this maximiz- 

ing combination /mai(w) (maximum absolute integral). By trial and 
error on a digital computer, the following sequence of signs for raised 
cosine shaping was found 

e„ = +1 except ei = 64 = —1 (105) 

/.nai(a.) = £/„(«) - 2[/ 1 (0>) +/*(«)]. (106) 

n=l 

This function is shown in Fig. 7. The worst peak-to-peak delay is 
positive when/ m ai(w) is positive and negative when/ mai (w) is negative. 
This worst delay curve is also shown in this figure. It is rectangular in 
shape with the single axis crossing at co = 0.32n-. The integral of | / ma i(w) | 
was computed numerically, so that from (104) we have 

D ^ - X 1.293 X h (peak-to-peak delay) (107) 

T 2 

D ^ 0.412 X (peak-to-peak delay). (108) 
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Fig. 7 — Peak bound on distortion; D = 0.412 X (peak-to-peak delay). 

For example, the peak-to-pcak delay of the cosine delay example was 
1.0 and so the bound on D is 0.412 for this particular class of delay 
waveforms. 

4.3.4 The Effect of Increasing the Period T on Distortion 

It is possible to decrease the distortion due to intersymbol interference 
by sending symbols at a slower rate. If the same information rate is to 
be retained, the amount of information a given symbol conveys must be 
proportionally increased. With more symbols to be distinguished at the 
receiver, the smaller amount of distortion may be even more troublesome 
than before the rate was diminished, so there is a question as to whether 
or not the system performance for a given information rate can be 
improved by sending at a slower rate. 
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We consider a binary AM system. We previously found that the dis- 
tortion from the normalized quiescent values of + 1 and — 1 is limited by 
the inequality 

D ^ 1.15 X rms delay. (109) 

Suppose that we now send at half speed and, in order to maintain a con- 
stant information rate, change from a binary system to quaternary. First 
we compute a new value for sensitivity using the period T = 4. 

Obviously the same functions / n (o>) that we computed before still 
apply, with the change that we now use fo n (<a) instead of /„(co). Now 
there is no overlap in the successive cosine terms in /„( to) and/ n:t i(to) and 
the terms /„( co ),/„,(«), n ?± m are very nearly orthogonal. 

Assuming orthogonality we can easily compute the sensitivity from 
(65) 

sensitivity = -^ [ £ || /*, || 2 1 (110) 

sensitivity = 0.628 

D( half speed) ^ 0.628 X (rms delay). (Ill) 

However, in an n-level AM system the amount of distortion necessary 
to cause an error is 

D (error) = — — -. (112) 

71—1 

The eye opening is defined as unity minus the ratio of distortion to the 
amount necessary to cause an error 

/move am = 1 - (n - l)D. (113) 

Therefore we have for the same information rate 

/binary ^ 1 - 1.15 X (rms delay) (114) 

/quaternary ^ 1 ~ 1-884 X (lTOS delay). (115) 

It is seen that the system has been made more susceptible to delay dis- 
tortion by sending at a slower speed with proportionally more informa- 
tion per symbol. However, for any particular delay curve either system 
may perform better than the other. In comparing the two systems the 
statistics of the particular ensemble of delays to be encountered should 
be taken into consideration. Lacking any such statistics, the binary sys- 
tem is the obvious "minimax" choice in that it has less sensitivity to 
delay than the quaternary system. 
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4.3.5 Zero-Distortion Delay Functions 

We have derived upper bounds on distortion as a function of rms and 
peak-to-peak delay. Now we might ask for some corresponding lower 
bounds. Since distortion is a positive quantity, we might wonder if it is 
possible to have zero distortion for some nonconstant delay curves. The 
distortion has been shown to be the sum of absolute values of certain 
linear functionals (/3',/„). Thus, to achieve zero distortion each of these 
functionals must be identically zero. In other words, the delay /3'(co) 
must be orthogonal to each of the functions /„ . This leads naturally to 
consideration of the completeness of the infinite sequence of functions 
{/„} . If this sequence is complete in the space L 2 (0,t) then there exist no 
delay functions in this space for which the distortion is identically zero 
(see, for example, Ref. 6). 

Actually, we have already demonstrated that constant functions are 
orthogonal to all /„ , so trivially the sequence is not complete. However, 
we are not particularly interested in constant-delay functions, so we 
might as well append a constant function to the sequence {/„} and con- 
sider the augmented sequence. That this sequence is not complete either 
may be easily proved by finding a function which is orthogonal to all /„ . 
For this purpose we write 



/„(co) = a n n(o}) + — -^- cos (2n — l)co + — cos 2nco 

+ 2(^TT) cos (2n + 1)co 



(116) 



M 



(to) = cos a) + w sin co + — — ( 1 + — I. (117) 



Now observe that a function of the form 

^„(co) = cos 2wco + h\ cos (2n + l)co + b 2 n cos (n -f 2)co 

+ b 3 n cos (2n + 3)co + bi n cos (2n + 4)co 



(118) 



can be made orthogonal to all /„(co) by proper choice of the coefficients 
b n . The four simultaneous conditions on these coefficients are 

(*« , m) = 

* ,/ - ) -° (119) 

(*„,/„_i) = 

(^, ( ,/ n+1 ) = 0. 
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These four conditions insure the orthogonality of ^„ and f m , since for 
m > n + 1 and m < n — 1 there is no overlap in the cosine terms and 
we made \f/ n orthogonal to /z, which constitutes the remaining portion 

oifm . 

Inserting (116), (117) and (118) into the four simultaneous equations 
(119) yields the result 

K = J^Zl- (120) 

w(2w — 1) 

V = -'fr + V (121) 

n(2n — 1) 

fc" = (2» + 3)(2n + 5 ) (122) 

n(2n — 1) 

( n + 2)(2» + 5) (123) 

n(2n — 1) 

Some special considerations come in when solving for rf/o(o)), which is a 
little different from the others. We merely quote the result here 

\f/ (o}) = cos co — 6 cos 2co + 15 cos 3w — 10 cos 4co. (124) 

Thus, we have derived an infinite sequence of functions all of which 
are orthogonal to {/„} and therefore are distortionless. What we would 
really like to do, however, is to find all the functions which are distor- 
tionless in the space L 2 (0,r). We designate the subspace consisting of all 
distortionless functions as G. We call the linear manifold spanned by the 
sequence {/„} the distortion subspace, F. Each delay function in L 2 (0,ir) 
can be expressed as the sum of two orthogonal functions / C F which 
causes distortion and g <z G which is distortionless. 

L 2 (0,tt) = F ® G. (125) 

We can form a sequence of orthonormal basis functions for F by ortho- 
normalizing the sequence {/„}. Unfortunately the sequence {^„} is not 
complete in G. For the purposes of analysis a sequence of approximate 
basis functions for G may be derived by the following procedure. 
(i) Approximate /„ to the desired accuracy by 

M 

fn= Sa m (n) cosmw. (126) 

(u) Orthonormalize the functions /„ ; n = 1, 2, • • • , (M — l)/2 
giving (M — l)/2 orthonormal basis functions in the M -di- 
mensional space of the approximation. 
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Table I — An Approximate Set of Orthonormal Basis Functions 
for the Space G of Distortionless Functions 



w 



£ g„ = ai cos co + a 2 cos 2co + a 3 cos 3« + 



+ an cos 11 o) 





«1 


Si 


£> 


S* 


86 


e> 




0.8478 














-0.5053 


-0.2887 


-0.0016 


-0.0004 


-0.0001 






-0.1042 


0.8087 












0.1136 


-0.4837 


-0.3296 










0.0435 


-0.1483 


0.8233 










-0.0016 


0.0766 


-0.4322 


-0.3540 








0.0044 


0.0251 


-0.1445 


0.8259 








0.0092 


-0.0131 


0.0713 


-0.4078 


-0.3687 






0.0066 


-0.0049 


0.0252 


-0.1443 


0.8295 






0.0047 


0.0018 


-0.0116 


0.0664 


-0.3819 


-0.4138 


(l\\ 


0.0021 


0.0008 


-0.0053 


0.0302 


-0.1736 


0.9104 



(Hi) Derive the missing (M + l)/2 orthonormal basis functions in 
this M-dimensional space. These are approximately g n ; n = 1, 2, 
••• ,(M + l)/2. 
(iv) g = 1 . 

The reason this procedure works well is that each successive function /„ 
adds strong components of cos 2nw and cos (2n + l)w as the sequence 
{/„} is orthonormalized. The g„ functions "interleave" to form a Fourier 
series. For M - 11 the six g functions thus generated are given in Table I. 
Now any linear combination of the functions o n (a>) has zero distortion. 
In particular, for any given delay curve we can find the closest distortion- 
free curve. This would indicate the minimum amount of equalization 
necessary to eliminate intersymbol interference. This nearest distortion- 
free function may be found by taking the projection of the particular 
delay j3'(«) onto the subspace G 



Pg(P') = E (0',9n)9n ■ 



(127) 



In Figs. 8 and 9 an example of the use of (127) is shown. In Fig. 8 we 
consider a cosine delay, /3' = cos 3co, which we have previously considered 
(see Fig. 4). The projection of this delay on G using (127) is also shown 
in Fig. 8 and their corresponding impulse responses are shown in Fig. 9. 
Notice that the samples h n of the impulse response of the uncorrected 
delay are poor. There is a peak in the response between hi and h% which 
we expect from our previous considerations in Section II. The corrected 
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Fig. 8 — An example delay function and the nearest distortion-free delay. 



delay seems to be a good fit in the interval [w/2,ir], and its response is well 
behaved, as is evidenced by the impulse response shown in Fig. 9. 

Thus, we have apparently found an infinite set of delay functions cor- 
responding to a particular amplitude characteristic such that the impulse 
responses satisfy the Nyquist criterion of regularly spaced zero crossings. 
Note that this was not possible for the case of flat amplitude character- 
istic mentioned in Section 4.2, since the set {/„} for this shaping is com- 
plete in the system bandwidth. For the raised cosine shaping we use 
more bandwidth for the same rate of transmission and consequently have 
more leeway in selection of good delay characteristics. 

Actually the responses h(t) corresponding to delays in G need not go 
exactly through zero at time / + nT, but only approach zero to the 
order of approximation employed in our original assumptions. Since 
ordinarily* the approximation is good to terms cubic in [o;/ — £(«)], the 



So long as S n ^ C» ; see Section 4.1. 
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fjg, 9 — Impulse responses of uncorrected and corrected channels. 

difference between h(t + -/iT) and zero becomes insignificant for small 
delays. 



4.3.6 Equalization 

There are several alternatives available when dealing with delay dis- 
tortion. One alternative is the use of automatic equalization, whereby 
channel characteristics are measured and automatically equalized at the 
transmitter or receiver. Another alternative is the use of compromise 
equalization, in which a fixed network or a choice of fixed networks is 
designed to provide for average correction over a particular range of 
•channels. Finally, one can do nothing to the system while amusing one- 
self with calculations of degradations in performance. We always assume 
that the particular channel to be used for transmission is chosen ran- 
domly for each call, so that it is not economically feasible to design an 
equalizer for each channel to be used. 

For a fixed delay characteristic, the last section shows that there are 
an infinite number of all-pass networks which will provide near perfect 
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equalization. The network with least rms delay has delay /3 C ' = — /?' -+- 
P G (/3'), and in general any function g(u) C G may be added to this 
delay so long as the approximation remains valid. Thus, the particular 
function easiest to realize physically may be chosen from this class of 
functions. 

Now suppose we desire to design a delay equalizer to work over a 
certain class B of delay functions. For each call, the delay /3'(co) is to 
be chosen randomly from this ensemble. The optimum compromise 
equalizer /3</(w) is to be chosen such that the average distortion over 
the ensemble B is minimized. Since the delays /3'(w) (random) and 
/3/(co) (fixed) simply add, we have for the resulting distortion 

D = 2 f; | 03' + &/,/„) | (128) 

T n=l 

D=-i,\ (£',/») + (&',/») I • (129) 

7T n=l 

The expected value of D averaged over the ensemble B is written 

E[D] =-T,E[\ (/3',/„) + (ft/,/.) | ]. (130) 

7T „=1 

This is the expression to be minimized by choice of &'. Knowing the 
statistics of the ensemble of channels we can derive the joint distribution 
of the variables *S„ = (/3',/„) and the marginal distributions p(S n ). In 
terms of the latter distributions we have 

E[D] = - £ [ \8n+ (0/,/n) | p(Sn)dSn. (131) 

IT 71=1 J—<* 

Each term of the summation is positive, and it is possible to specify in- 
dependently each component (/?/,/«) of /5/. 

Therefore, we simply choose each component (@c',f n ) so as to minimize 
the corresponding term of the summation (131). Each integral may be 
written 

I— (Pc'.fn) 

In = [S n ~ ((3e',fn)]p(Sn)dS u 

J— CO 

(132) 

+ [ [Sn+ (,3c',fn)MS n )dS n . 

Differentiation with respect to (/3/,/ n ) yields the stationary point 
(/3/,/n) chosen such that 
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/—(0c './..) 1 

p(S n )dS n = 5. (133) 

Therefore, each component (/3 r ',/„) of the compromise delay is optimally 
chosen such that it is the negative of the median value of S„ . The compro- 
mise delay /3 C ' is not uniquely specified by these components; only its 
projection onto the space F has been determined. A& before, any function 
g(u) d G may be added without affecting the optimally of the resulting 
equalizer. 

As a somewhat trivial example, suppose we desire to equalize a set of 
channels bounded by the narrow "ribbon" of width 2A. 

0o'(«) - A g j8'(«) ^ o '(w) + A. (134) 

Now suppose that each of the scalar products (/3',/„) is equally likely to 
be greater or less than (0o',/»). In this event the completely trivial solu- 
tion is to use /3 C ' — — 0o' + 0- In particular, the smallest rms function 
of this sort is 0j = -/So' + Poifo')- The residual delay in using this 
equalizer is bounded by ±A across the band (plus a harmless g func- 
tion), and our peak-to-peak distortion bound derived previously may be 
used to give 

D residual ^ 0.824A. (135) 

4.3.7 The Range of the Approximation 

The key approximation made in the analysis thus far has been that 
Mo — /3(to)] is small enough to use 

sin Mo - (3(w)] % Mo - 0(»)] (136) 

where / is chosen to be the time of the peak value of the impulse re- 
sponse. We will now briefly examine the range of delay for which this 
approximation is valid. 

By setting h'(t Q ) = 0, we were able to derive an expression relating 
to and the phase shift, /3(w). This equation, (47), was 

/ wA(w)/3(co) du 
to - ^_ (137) 

/ o) 2 A(o}) do) 
Jo 

and this was the value used for t in (136). 

Now we will demonstrate that the resulting function [uto — /3(o>)] is 
the err or An a least-squares straight-line fit to /3(w). Hence, consider fitting 
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a straight line y = cu to the phase curve /3(o>). The integral square error 
in the fit weighted, as all our integral expressions are, by the amplitude 
shaping A(w) is 

integral squared error = / [cw — /3(go)] 2 .<4 (cu) dw. (138) 

By minimizing the error (138.) with respect to c and using (137) we ob- 
tain c m in = to ■* Thus, the use of the peak time of the impulse response 
for t results in the smallest values of [u)t — j8(w)] in a mean-square 
sense, which was an assertion previously made in connection with the 
choice of / • Also, we see that the time / is the slope of a best fit straight 
line to the phase /3(w). This state of affairs is depicted in .Fig. 10. 

In order to be assured of, say, 10 per cent accuracy in the use of ap- 
proximation (136), we might guarantee that [ut — /3(w)] ^ ir/4. Thus, 
the phase should not deviate from a straight line by more than t/4 
radians. (Of course, these are sufficient but not necessary conditions for 
10 per cent accuracy. ) Now we ask what limits we may put on peak delay 
such that the phase will meet this condition no matter what the exact 
shape of the delay happens to be. Remember that (3(0) = and /3'(a>) ^ 
for physical realizability. 

This problem is best suited for the semi-mathematical method called 
"common sense." Since the delay is to be peak limited between /3' ma x 
and 0, we allow only use of these two extreme values in finding the shape 
of delay such that the deviation of its integral (phase) from a straight 
line is maximized. Furthermore, it is evident that only one transition 
from /3' = /3'mnx to /3' = should be used in the interval [0,10]. The reader 
may convince himself that more transitions in delay would result in a 
better straight-line fit to the phase. Therefore, the shape of the phase 
which for a given peak delay results in the poorest use of the approxima- 
tion (136) is specified except for the transition point wo • This situation 
is shown in Fig. 1 1 . 

For raised cosine amplitude shaping, the error near the edge of the 
band is very lightly weighted, and so we take the error at w = o?o as the 
largest important error. This error is equal to u l Q and is to be maximized 
with respect to the transition point wo . 



«10 

E = mto = — / «A(«)j8(w) do) (139) 

m Jn 



* This expression with c = tj may be used as a useful distortion measure relat- 
ing performance and phase shift. For an AM system operating at rate 2W symbols/ 
second this may be shown to be proportional to the mean-square estimation error 
at the receiver due to intersymbol interference. 
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Fig. 10 — Factors involved in the approximation, 
where m is a constant 

nW 

m = I w A(co) du. 
Using the curve j3(co) shown in Fig. 11 gives 

E = -° /"" co/3' max (co - coo)^(co) dco 

dE = ^x f r j Mo)) dio _ 2wo r wA ( w) da 

For the raised cosine shaping the maximum point of (141) may be 
found by a solution of the resulting transcendental equation when 
dE/duo = and A(w) = cos co + 1 are used in (142). This procedure 
yields 

coo = 0.2557T. (143) 

Notice that the corresponding delay curve is very similar to the worst 
delay from the standpoint of distortion, which is shown in Fig. 7. For 
this choice of co we may evaluate the maximum error from (141). 

iw = 0.37/3' m «. (144) 
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Fig. 11 — Most unfavorable (approximation poorest) delay curve for a given 
peak value. 

For this error to be less than x/4 for an assured 10 per cent accuracy, 
we finally arrive at 

/3' ma x ^ 2.12. (145) 

Thus, as long as the delay variation does not exceed 2.12 seconds across 
the band we are assured of at least 10 per cent accuracy in results re- 
gardless of the actual shape of the delay. This is, of course, normalized 
for the choice of co = ir and T = 2 seconds, so that 2.12 seconds of delay 
variation corresponds to 1.06 pulse intervals. 

When the delay differs from the worst form we have just derived, the 
approximation holds for greater ranges. For example, we found that for 
the parabolic delay discussed in Section 4.2.2 the approximation was 
accurate to within 10 per cent in spite of a total delay variation of 4 
seconds across the band. The important consideration is that the dis- 
tortion is quite appreciable before the approximation breaks down. From 
the peak distortion bound derived previously, we find that the distortion 
corresponding to a variation of 2.12 seconds may be as large as 0.873. 
There is a definite connection between the value of the distortion and 
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the goodness of the approximation through the validity of (138) as a 
distortion measure. Thus, we would expect that the techniques would be 
accurate in nearly all cases of, roughly, D S 0.6. For this value of 
distortion, the eye in a binary system is more than half closed, and the 
channel may be unsuitable for higher alphabet size transmission. 

4.3.8 Channel Memory Truncation Error 

Theoretically, the response from a band-limited network lasts to in- 
finity, so that in calculating distortion an infinite number of terms must 
be used for the criterion D 

D=Z\h n \. (146) 

In many analysis problems and particularly in experimental work and 
computer simulations it is necessary to neglect the channel memory for 
\t\ > NT seconds. In experimental runs and computer simulations this 
corresponds to using all possible patterns of length 2N + 1 symbols. 
The problem arises as to how much of an error can be made in computing 
the distortion D using a finite number of terms. 

Assume that the terms | h n | for | n \ > N are to be neglected in the 
summation. The error in computing D is 

E(N) = E | A. |- Z \h n \ (147) 



E(N) = ZJM + S.JM- ( 14 8) 

As we have previously shown, this expression is approximately equal to 

E(N) =- E |(/»,/3')| (149) 

■K n=A'+l 

and thus the error can be bounded using the Schwarz inequality on the 
maximum energy combination of the functions /„ , n — N + 1, ••• , °°. 
For iV > 3 we may as well neglect the terms in /„ involving the fast- 
vanishing constant a„ , leaving only the three cosine terms. Obviously, 
the maximum energy combination of these is all terms adding in-phase 

#(A0 g -^- X (rms delay) X || & \\ (150) 

Wit 
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Cat = 4/ _ 

3 2(2JV+1) 2 






(151) 

(152) 

(153) 
(154) 

(155) 
(156) 



As shown in Fig. 12, this bound drops rapidly for N small and then 
levels out to a very slow descent, so that some 20 per cent of the original 
distortion bound can still remain after consideration of 16 pulse intervals 
on each side of the peak. This rather negative result tells us only that 
there exist mathematical delay functions that have considerable distor- 
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Fig. 12 — An upper bound on distortion arising from symbols at a distance 
greater than N. 
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tion at great distances from the reference (peak response) time. These 
functions, however, are high-frequency waveforms which would not 
ordinarily be encountered. 

Consider a computer simulation in which 40 samples across the band 
[0,*-] are used to specify the delay. The highest delay frequency which 
need be considered is then 20 cycles of delay across the [0,ir] band. Con- 
sequently, only the functions /„ for n ^ 20 will contribute distortion 
components. In order to test distortion over this interval it would be 
necessary to test 2 40 sequences of binary symbols, which is, of course, 
quite unreasonable. Therefore, the effect of intersymbol interference is 
usually only measured to the extent of, say, four symbols in either 

direction. 

We can find the maximum error now by computing the norm of the 
sum of the functions /„(«), n = 5, 6, • • • , 20 



40 



1 1 

£5,2o(w) - £ - cos nu - — cos llw (157) 

n = ll n &i 



•10 



i^-ilSi-i}- (158) 

The sums involved in the expressions are conveniently computed using a 
Euler-Maclaurin expansion for the integral of 1/.T 2 . This gives 

#6.20 ^ 0.352 X rms delay (159) 

which is still a considerable error, even though the delay is bandwidth 
limited. 

In all our computations of distortion bounds we have been using the 
maximum energy combination of the functions ±/„(a>). For each par- 
ticular delay it will be one of the combinations of functions ±/„(w) 
which defines the distortion functional, not necessary the maximum 
energy combination. However, it is interesting to note that the combina- 
tion with least energy would only result in a factor of y/2 in the bounds 
calculated. 

V. THE RELATIONSHIP OF DISTORTION TO DELAY FOR BANDPASS SYSTEMS 

5.1 Derivation of the Sequence of Functionate Involved for Bandpass Sys- 
tems 

In dealing with bandpass systems, the system impulse response is 
most conveniently given in terms of its envelope and phase with respect 
to a carrier or other reference frequency within the bandwidth of the 
system 

h(t) = Pit) cosM - *(*)]■ ( 16 °) 
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Alternately, the response may be written in terms of in-phase and quad- 
rature components at the carrier frequency 

h(t) = R(t) cos <a t - Q(t) sin w E t (161) 

P(t) = VR 2 (t) + Q*(t). (162) 

As discussed by Sunde, 1 the in-phase and quadrature components of 
the impulse response may be related to the amplitude and phase charac- 
teristics of the channel's frequency domain description by a simple 
transformation of the defining Fourier integral. This transformation to 
passband coordinates gives 

R(t) = - [ a(ta) cos [<at - <p(a)]dio (163) 

IT J-l> c 

1 r 

Q(l) = - / a(u) sin [tat - ip(ta)]d(a. (164) 

IT J-a> c 

In this section we use 6,(01) and (p(oj) for amplitude and phase instead 
of A (a>) and fi(u) since these functions are now defined with respect to 
the carrier frequency, o> c . That is 

a(ta) = A(a e + w ) (165) 

<p(w) = P(<a e + w). (166) 

Now we will work under the hypothesis that a suitable criterion of 
distortion for bandpass systems is 

D = S P(nT + to) = Z' Pn ■ (167) 






This criterion is similar to the low-pass criterion, except we now assume 
that the receiver makes use of the envelope properties of the impulse 
response. 

In terms of samples of the quadrature components we have 

D = E' VRn 2 + Qn 2 - (168) 

Unfortunately this is a fairly hopelessly nonlinear criterion to work with, 
so we shall make the judicious approximation shown in Fig. 13. Here we 
take the distortion D as the length of the vector formed by summing all 
vectors of the form 



'■Z 



tan" 1 ' Q " 



Rn 
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Fig. 13 — The approximate distortion criterion for bandpass systems. 
Thus we have 



D « VDr 2 + D q 

Dr-Z'\ *■ I 

D«-E # l«-|. 



(169) 
(170) 

(171) 



Now, the component distortions D r and D q are of the same form as the 
low-pass distortion treated previously. We take D,, as an example in 
what follows 



(172) 



Q„ ± <?_„ = - ( a(w) {sin [«(/„ + »D - *»(«)] 

± sin [w(/ — w5T) — ^(o>)]} rfai 
Q« + Q-n = z I Cl(«) sin [co< - p(w)] cosnwTt/oj (173) 

7T J-u e 

Q« - Q-„ = - / Gt(w) cos [oj/o - *>(«)] sin nuT dw. (174) 
Using the approximation [o>/ — ^(w)] small gives 
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Qn + Q-n « - / a(co)Mo - <p(u)] cosnwTdco (175) 

Q„ - Q-„ « (176) 



2 1 r" 

Q„ | + | Q-» | « - / a(co)Mo - <p(co)] cos nw7' dc 

7T J— a. 



(177) 



Notice that in (177) the quantity (Q n — Q- n ) need not be identically 
zero as in the approximation (176), but should only be smaller in ab- 
solute value than the quantity (Q n + Q-n). 

We find the time of the peak value of the impulse response, t , by 
requiring R'(to) = 0. The quadrature component goes through zero at 
= and is small enough at / to be neglected 

R'(to) = = — / coa(aj) sin Mo - *>(«)] dw (178) 

T J-u c 

fcoCt(o))<p(o)) da) 



/ ua(u)du 

J— M - 



(179) 



This is incidental to the development of the quantity | Q n \ + | Q-n |, 
because for symmetric shaping of Cfc(a>) the terms involving t Q in (177) 
integrate to zero. This shows that the antisymmetric portion of the 
delay <p'(o)) does not have a first-order influence on t . However, in 
solving for | R n \ + | R- n | the equations do involve t in first-order 
terms. 

To maintain notational continuity with low-pass results as much as 
possible we designate 



S gn = — I d(u))[(j)to — (p(co)] cosncoTdu 

J—u c 



(180) 



|Q.| + | Q-» | =-\S git \. (181) 

7T 

For &(io) symmetrical about zero (the carrier frequency) (180) be- 
comes 

S gn = I v((a)a(a)cQ8noTda. (182) 

J—u e 

We integrate by parts and make the arbitrary assignment of zero phase 
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shift at the reference frequency to obtain* 

S qn = (/,»(«)*>'(«)<*« - (/*.,*>') (183) 

•>-u>/2 

/„(«)= f a(x) cos nxT dx. (184) 

A similar development holds for the terms | B n | + | R~ n \, and the 
resulting expressions are exactly the same as the low-pass equations 
except they are translated to the reference and are denned for both 
negative and positive deviations from this reference 

\Rn\ + \R-«\ = 2 \Srn\ (185) 

IT 

S rn = [ /«(«)*'(«)<*« = (frn,*) (186) 

J-wl2 

f r „((a) = / [otnX - sin nxT]a(x) dx (187) 

/w/2 
coCt(w) sin nccT do: 
w/2 



at,, = 



,W2 

J- w 1 2 



(188) 



do: 



To briefly summarize, we have written the distortion in a bandpass 
system as the length of a vector whose two quadrature components are 
D r and D Q 

D = V-Dr 2 + D q *. (189) 

Each of these components is the sum of the absolute values of a sequence 
of linear functionals of delay 

D r = -Z |(/»V)| (190) 



IT n=l 



o g = -j: \(u,<p')\. (19D 

7T n=l 

The functions f rn and /,„ are of course independent of delay and are ob- 
tained from the amplitude characteristics by operations (187) and ( 184). 

We are working with symmetric amplitude characteristics, and con- 
sequently it may be seen that 

* Another choice of reference phase may easily be made here. 
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/..(«) = -/•(-•) (192) 

/,„(«) =/r»(-co). (193) 

The quadrature functions f gn are odd functions of frequency and the 
in-phase functions f Tn are even functions. The two parts into which the 
distortion was divided therefore arise separately from the odd and even 
portions of the delay. For example, if the delay is an even function, 
D q = and the only distortion is D r . Since D r is defined identically 
except for a translation as the low-pass distortion D, we have the neces- 
sary result that the system may be treated as low-pass with identical 
results in the event of even delay. Obviously also 

(fr„ ,/,„) = all n and m. (194) 

The delay function <p'(a>) may be divided into its even and odd com- 
ponents, tp T '(tii) and <p q '(m), and the analysis of the distortion properties 
of each of these components proceeds exactly as in the low-pass analysis. 
For the even component of delay, we use the functionals defined by the 
sequence {/„,} and for the odd components we use the sequence \f q „\- 
The two distortions D r and D,, are then added root-sum-square. 

5.2 The Raised Cosine System 

5.2.1 The Functions f r „ ( co ) and f q „(<a) 

We now consider the use of an amplitude shaping of the raised cosine 
form 

G(w) = Kl + COSOJ) —K ^ CO ^ +7T. (195) 

By substitution into equations (188), (187) and (184) the following 
results are obtained 



1 



ot n — T~T 

2 



(196) 



(*L- 2\2iMn l - 1) 
fnM = ijr cos w + co sin co 4- — — f 1 + ^-J 

+ 777^ 7T cos (2» — l)co 4- -— cos 2nco (197) 

4(2n — 1) 4n 

+ ... 1 ,. cos(2n + l)(o 
4(2w — 1) 



/«•(«) - 
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(198) 



+ 77^ 



sin (2ft + l)w. 



4(2ft + 1) 
The first few pairs of these functions are shown in Fig. 14. 

5.2.2 Sample Distortion Calculations 

Having assumed any particular shape of delay curve, one may easily 
compute the resultant distortion to the desired accuracy by computing 
a number of the linear functional. Although the primary use of these 
functionate is in understanding the effect of shape in delay on the dis- 
tortion and in ascertaining bounds and other factors in this relationship, 
it is quite necessary that when confronted with the reality of an actual 
system the mathematics be able to predict specific results. 

First, we consider a check on the mathematical methods and approxi- 




Fig. 14 — Some of the functions/™ and /,„ for raised cosine shaping. 
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mations used. Consider the effect of linear delay on the raised cosine 
response 

p'(w) = ka. (199) 

Since this delay function is odd, the products (/ rn ,<p') vanish and the 
only distortion is D q . For adjacent symbol interference we have 

P x + P-i = - | S ql J - ? | (U,hu) | (200) 

X 7T 

(/ 8 i,M = j[^ W gl (a,)tfa> - ^& (201) 

P, + P_i - llfc/18. (202) 

For a specific example we take k = 2/t which gives 

P, + P_, = 0.389 (predicted) (203) 

while from Sunde 2 the computed impulse response for this value of 
slope is 

l\ + P-x = 0.387 (computed). (204) 

The agreement here is probably better than should ordinarily be ex- 
pected. 

Now we turn to predicting the performance, measured by the eye 
opening, of the four-phase data subset. As explained in the previous 
chapter, this system is inherently nonlinear and using I = 1 — D as the 
eye aperture for this system involves a certain approximation. In par- 
ticular, we will examine the performance of this system for delay of the 
form 

<p'(u) = a sin vu (205) 

since there are published results for this choice of delay. Again we are 
dealing for the moment with an odd delay function and need only evalu- 
ate D g . As a function of the number of delay ripples in the band, v, 
the various products (/„„ , <p') are easily visualized, since f gn consists of 
only three sine terms itself. The behavior of these products is very nearly 
like the behavior of its cosine counterpart shown previously in Fig. 4 
and will not be depicted here. In Fig. 15 the distortion for a = 0.5 
calculated by summing these products is illustrated as a function of v 
along with the corresponding curve from Rappeport. 7 The latter curve 
was obtained by use of a computer simulation of the system, and the 
agreement between this simulation and actual results is claimed to be 
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Fig. 15 — The performance of a four-phase system for sine and cosine delay. 

excellent. Two other curves are also drawn in Fig. 15 representing the 
system performance for cosine delay variation previously shown in Fig. 
5. Notice that the slight difference in rate of deterioration of performance 
at low frequency between sine and cosine delay is correctly predicted by 
the mathematical model. 

To test the mathematical model with delay which has both odd and 
even components, we turn to published results concerning a different 
data system. This system is an amplitude-modulated system investi- 
gated by computer simulation by R. A. Gibby in Ref. 8. Again our cri- 
terion is not expected to hold exactly, since Gibby 's binary system is an 
on-off system rather than bipolar. Gibby considers delay of the form 



<p'(o)) = a cos (bu + 



(206) 



and plots loci of constant eye aperture (constant distortion) on a polar 
diagram of delay amplitude a and phase for a given value of delay 
frequency 6. The quadrature components of the distortion for the delay 
(206) are 



D r = - a cos 9 X) I if™ , cos bo}) 



D t = - a sin 9 £ | (/,„ , sin bu) | . 



(207) 
(208) 



The integrations are performed and summed to give (for b = 1.5) 

D r = 0.508 a cos 6 (209; 
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D q = 0.590 a sin 

D 2 = 0.258 [a cos df + 0.348 [a sin 0] 2 . 



(210) 
(211) 



Therefore, lines of constant distortion are ellipses on a polar chart of 
a and 6. Fig. 16 shows two of these ellipses of constant distortion with 
b = 1.5 along with the corresponding curves obtained by Gibby. 

Figs. 15 and 16 demonstrate that the mathematical model has pro- 
vided a good description of the behavior of two diverse modulation 
systems under the influence of delay distortion. 
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Fig. 16 — Loci of constant eye aperture for cosine delay. 
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5.2.3 Sensitivity and Bounds on Distortion 

In the low-pass analysis we found the system sensitivity, which we 
defined as the maximum achievable distortion for one rms unit of delay, 
by summing the functions ±/„(w) in such a fashion as to produce a 
combination of greatest energy. Obviously, in the bandpass case we can 
bound both distortion components in like fashion. The system will have 
a certain sensitivity to even delay and a certain sensitivity to odd delay. 
Any delay function can be divided into its odd and even components and 
these components are orthogonal. The contribution to the distortion 
from each is bounded by the system sensitivities to odd and even delay. 
Now we ask for a given rms value of delay, how should the delay energy 
be divided between odd and even components such that the distortion is 
maximized? Naturally, all the delay energy should be put into the com- 
ponent (odd or even) which has greatest sensitivity to delay distortion. 
Therefore the over-all system sensitivity is the maximum of the pair of 
odd and even delay sensitivities. 

The sensitivity to even delay is the same as the sensitivity calculated 
previously for low-pass systems: 

even sensitivity =1.15. (212) 

For the sensitivity to odd delay, we find the maximum energy combina- 
tion of the functions ±/ 9 „(w). This is found trivially as the sum of the 
functions /q„(aj), since all the terms add in phase in this sum 

SO 

f qm M = Z /,»(«) (213) 

n=l 

( . 1 ^ sinrico sinw , . 

Amec(aj) = - £_, — - —J" (214) 

- m=i n -± 

[\{tc —a — sin «) us = 

/„nec(o>) = (215) 

[j(—t — CO — sin CO) CO < 0. 

This particular form of delay is the worst odd delay for a given rms value 
and is shown in Fig. 17. The norm of this function is 



11/,™ || =\y ~ -^= 0.835 (21G) 

and the sensitivity becomes 

/2 

odd sensitivity = 2 A/ - \\ f gmec \\ = 1.337. (217) 
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Fig. 17 — Bounds on distortion for bandpass, raised cosine systems. 

Thus we see that the bandpass, raised cosine system is somewhat more 
sensitive to odd delay than it is to even delay. The over-all system sen- 
sitivity is therefore equal to the odd sensitivity and consequently we 
have 



D g 1.337 X (rms delay). 



(218) 



Also, the delay curve / gra ec(w) in Fig. 17 becomes the worst shape a 
delay can assume for a given rms value of delay. 

For a peak-to-peak constraint on delay, the technique for bounding 
the distortion is less obvious. Clearly we can find the combinations of 
signs { e Tn } and { e qn \ such that the resulting functions 

*r(«) = EW» •»- ±1 (219) 

n=l 

/«(«) = E «■.'•.(•) ^=±1 (220) 

n=l 

have maximum absolute integrals and the distortion may be as large as 
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Table II — An Approximate Set of Orthonormal Basis 

Functions for the Space G of Distortionless 

Functions for Bandpass, Raised Cosine 

Systems 
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0.0288 
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0.8234 








b t 


-0.0151 


0.0773 
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-0.3540 






67 
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-0.1444 


0.8260 






6 8 


0.0025 


-0.0128 


0.0713 


-0.4078 


-0.3687 




b, 


0.0009 


-0.0045 


0.0252 


-0.1443 


0.8294 




bio 


-0.0004 


0.0021 


-0.0116 


0.0664 


-0.3819 


-0.4138 


b u 


-0.0002 


0.0009 


-0.0053 


0.0302 


-0.1737 


0.9104 



* For values of a n see Table I. 



the greater of these absolute integrals. The question is, can we do better 
than this by using a delay with both odd and even components? 

If we were to use both odd and even components in the delay, the 
only acceptable strategy for maximizing distortion would be to use odd 
delay (*/(«) = — *>'(— «)) when |/,(co) | > |/ r (co) | and even delay 
(^)'(co) = <p'(—u)) when |/ r (co) | > | /«(&>) |.* In addition we would 
have to run through all possible sequences of the signs jt r „} and {c,„}. 
This procedure was carried out to the extent of time limitations on the 
IBM 7090 digital computer with the result that the best such delay has 
distortion less than a delay using an all odd strategy. 

The maximum absolute integral of f q (o>) is obtained by using e qn = 
4-1, i.e., by simply adding all the functions /,„(«). We found this func- 
tion previously as/ 8mec (w) 



7T J-r n=l 



(k 



D 



2 , [ +r 
^ - <p max I ! J(ir — co — sin co) I dco 

7T "Ml 



(!-!•'• 



D < x - - 



(221) 



(222) 



(223) 



* This is not exactly true, but an exact proof here does not seem to be worth the 
considerable effort involved. 



2480 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1903 

D ^ 0.467 X (peak-to-peak delay). (224) 

The worst peak-to-peak delay is simply positive when/ gme c(oo) is positive 
and negative when /,„,«.(«) is negative. This is a particularly simple 
delay function which is +y' max for w ^ and —<p' max for a> < 0. This 
function is also shown in Fig. 17. 

5.2.4 Zero-Distortion Delay Functions 

A space G of distortion-free delay functions for raised cosine systems 
may be obtained using techniques similar to the low-pass methods. After 
orthonormalizing the sequences |/ r „} and (/,„} , we find the orthonormal 
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Fig. 18 — Bandpass distortionless delays. 
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Fig. 19 — An example delay and the nearest distortion-free delay. 

functions which complete these sequences in their respective suhspaces 
of even and odd square-intcgrable functions. Thus we derive the se- 
quences \(/ ril \ and \g,,„\ of even and odd functions which span the dis- 
tortionless space G. Any delay <p' in L 2 ( — x, +x) can then be expanded 
in terms of the functions /,„ ,f qn , g r „ , and g qn with the terms involving g 
functions comprising the projection of <p' upon G and yielding zero dis- 
tortion and the terms involving / functions containing all the distortion 
content of <p' 



even odd 



(225) 



+ 2 c m Qrn + £ C qn g gn 
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ODD COMPONENTS EVEN COMPONENTS 




Fig. 20 — Resolution of the example delay into odd and even components. 

PaW) 

Cm = Wt 9rn) (grn , fr.) = U * M (226) 

c qil = (*>', Q qn ) = In = m. 

A list of the functions g rn and g gn obtained for raised cosine shaping is 
given in Table II, and the first few functions are illustrated in Fig. 18. 



1.0 
0.8 








-p, 

F 







0.6 










\ FOR <f>' =\ [cOSO> + SIN30j] 


0.4 
0.2 


- 


P. 


2 


FOR P G 


■7 

if 

i 
I 
I 




ft s 

X F 

\\ 
\\ 

\ 


/ 
/ 


>2 


-0? 















Fig. 21 — Impulse response envelopes for the corrected and uncorrected delays. 
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It is necessary here to reiterate the fact that functions g a G have zero 
distortion only to the extent of the approximations employed in obtain- 
ing the fundamental relationship for distortion in terms of the sequence 
of linear functionals. As an example computation a delay <p' = £[cos co -f- 
sin 3a>] is shown in Fig. 19. The odd and even components of this delay 
and their respective projections on G are shown in Fig. 20. Combining 
these projection components the total projection is shown in Fig. 19 
back with the original delay function. The envelopes of the impulse 
responses of the corrected and uncorrected delays are illustrated finally 
in Fig. 21. As may be seen from this figure, the correction is near perfect. 
The corrected envelope approaches zero at each sample point as close as 
the numerical integration techniques employed permit. 
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